Finite-Length Analysis of Irregular Expurgated 
LDPC Codes under Finite Number of Iterations 
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Abstract — Communication over the binary erasure channel 
(BEC) using low-density parity-check (LDPC) codes and belief 
propagation (BP) decoding is considered. The average bit error 
probability of an irregular LDPC code ensemble after a fixed 
number of iterations converges to a limit, which is calculated 
via density evolution, as the blocklength n tends to infinity. The 
difference between the bit error probability with blocklength n 
and the large-blocklength limit behaves asymptotically like a/n, 
where the coefficient a depends on the ensemble, the number 
of iterations and the erasure probability of the BEC. In |1|, 
a is calculated for regular ensembles. In this paper, a for 
irregular expurgated ensembles is derived. It is demonstrated 
that convergence of numerical estimates of a to the analytic 
result is significantly fast for irregular unexpurgated ensembles. 



I. Introduction 

In this paper, we consider communication over the binary 
erasure channel (BEC) using low-density parity-check (LDPC) 
codes and belief propagation (BP) decoding. It is important 
to predict the average bit error probability of an LDPC 
code ensemble for designing a practical code. The bit error 
probability of an ensemble is determined by a blocklength, 
erasure probability of a channel, and the number of BP 
iterations. Let Pb(n, e,i) denote the bit error probability of 
an ensemble of codes of blocklength n over the BEC(e) after 
t BP iterations. The limit of large blocklength of the bit 
error probability, denoted by Pb(oo,e,£), is obtained easily 
via density evolution J2). An important consequence is that 
there exists a threshold erasure probability of the channel, 
e B p, such that lim^oo Pb(oo, e, t) = if e < e BP , and 
lim^oo P b (oo, e, t) > if e > e B p. 

Although the analysis in the large-blocklength limit is easy, 
estimation of performance for finite blocklengths is much more 
complicated Q J4] 0. These analyses require high compu- 
tational costs which grow like a power of the blocklength and 
like an exponential of the number of degrees. 

A large-n asymptotic analysis is useful for avoiding high 
computational complexity. An asymptotic analysis of the 
large-i limit of the bit error probability below the threshold 
is shown in |6). However, the large-n asymptotic analysis in 
the limit t — > oo breaks down near the threshold: If the large- 
blocklength limit of the bit error probability is discontinuous 



at the threshold, the convergence is not uniform in regions 
including the threshold. If not, the coefficient of l/n diverges 
as e approaches the threshold from below. The scaling-law- 
based method [7] has been shown to be useful near the 
threshold. 

The large-n asymptotic analysis with finite t H) provides 
an alternative useful approach. Indeed, for a finite t, the 
convergence of Pb(«, e, t) to the limit Pb(oo, e, t) as n — > oo 
is uniform on e G [0, 1]. Hence, the asymptotic expansion 



Pb(n, e, t) = Pb(oo, e, t) + a(e, t) h o ( — 

n \n 



(1) 



is well behaved, so that approximations using ([TJ while 
ignoring the o(n -1 ) term should be accurate for all e uniformly 
if the blocklength is sufficiently large. The coefficient a(e, t) 
of n -1 for regular ensembles is obtained in (T). In this 
paper, a(e, t) for irregular expurgated ensembles is derived. 
In Section HIl outline of calculation of a(e,t) is described. In 
Section[Ill] a generalization to irregular ensembles is shown. In 
Section |IV] a further generalization to irregular expurgated en- 
sembles is outlined. In Section[V] numerical calculation results 
of a(e,t) for irregular expurgated ensembles and simulation 
results corresponding to a(e, i) for irregular unexpurgated 
ensembles are shown. Finally, we conclude this paper in 
Section |Vl] 

II. Outline of calculation of a(e, t) 

In this paper, we consider the standard irregular LDPC 
code ensemble (X(x),p(x)) where the degree distributions 
of variable and check nodes are fixed and where the set of 
edges is chosen uniformly from all possible choices. An error 
occurrence after t iterations depends only on a neighborhood 
graph G of depth t and channel outputs at variable nodes in 
G. Hence, the bit error probability of an irregular ensemble is 
calculated as 



Pb(n,e,t) 



Geg t 



?„(G)P b (e,G) 



where Q t denotes the set of all neighborhood graphs of depth 
t, where P„(G) denotes the probability that the neighborhood 
graph G is generated in the code ensemble considered, and 



where Pb(e, G) denotes the error probability of the root node 
of G after t iterations when each message into variable node 
in G is transmitted over the BEC(e). If we distinguished 
all sockets, the probability that a neighborhood graph G is 
generated would be 

1 

nE(E - 1) • • • (E - (k - 1)) 

where E and k are the numbers of edges in the whole Tanner 
graph and in the neighborhood graph G, respectively. This 
distinction is finer than necessary for our purpose, since we 
do not have to distinguish nodes of the same degrees, so that 
the following marginalized probability is considered. We order 
sockets in the same node and number them, and then identify 
the nodes with the same degree. We further identify sockets 
by their number in the cyclic sense. On this identification, the 
marginalized probability of particular neighborhood graph G 
is 



P„(G) :=nL, 



nE(E-l)---(E-(k-l)) 



(2) 

where u denotes the degree of the root node and where Vi and 
Ci denote the numbers of variable and check nodes of degree 
i in the neighborhood graph, respectively. 

The following lemma is an important consequence of ©. 

Lemma 1. For a neighborhood graph G which has c cycles, 

P„(G) = Q(n- C ) 

as n — > oo while the number of iterations is fixed. 

From Lemma [1] it holds that 

Pb(oo,e,t) = Poo(G)P b (e,G), 
GeT t 

where P 00(G) := lim„^ oc P„(G) and where T t denotes the 
set of all cycle-free neighborhood graphs of depth t. From 
this fact, the limit of the bit error probability Pb(oo, e,t) := 
lim rwoo Pb(n, e, i) is calculated recursively. 

Lemma 2 (Density evolution J2]). Let Q e (t) denote erasure 
probability of messages into check nodes at t-th iteration and 
Pe(t) denote erasure probability of messages into variable 
nodes at t-th iteration in the limit n — > oo. Then 

P b (oo,e,i) =eL(P e (t)), 

Q e {t) = e\(P e (t - 1)), 

'l, ift = 



Pe(t) 



1 — p(l — Q e (t)), otherwise. 



From Lemma \T\ we can see that the second dominant term 
is 0(n -1 ). The coefficient of n _1 , defined as 

a(e,t) := lim n(Pb("., e, t) — Pb(oo, e, t)), 

n — >oo 

determines the speed of convergence of P^(n,e,t) to 
Pb(oo, e, t) as n tends to infinity. Furthermore, Lemma[T]tells 



us that a(e, t) can be decomposed into two components as 
follows: 

a(e, t) = lim n I V P„(G)P b (e, G) - P b (oo, e, t) ) 
\GeT t / 

+ lim n Y P n (G)P b (e,G) 



GeSt 



where St denotes the set of all single-cycle neighborhood 
graphs of depth t and where f3(e, t) and j(e, t) represent 
contributions from cycle-free and single-cycle neighborhood 
graphs, respectively. In [1], 7(e,£) was derived for irregu- 
lar ensembles, whereas /3(e, t) was derived only for regular 
ensembles. In this paper, /3(e, t) for irregular ensembles is 
shown. Furthermore, we consider the expurgated ensembles 
defined in [6| and outline derivation of a(e, t) for the irregular 
expurgated ensembles. 

III. /3(e, t) FOR IRREGULAR ENSEMBLES 

The contribution /3(e, t) of cycle-free neighborhood graphs 
is calculated as 

P(e, t) := lim n I V P„(G)P b (e, G) - P b (oo, e, t) ) 
\GeT t J 

= V [lim n(P„(G)-P 00 (G))lp b (e,G). 
GeT t 

The contribution of a neighborhood graph G to /3(e, t) is 
obtained as 

}™L L M II A M II P\dpb(e,G) 

v£V(G)\u cSC(G) 



x n 



n?=o^-<) 

L\ u \ n A,., y[ ^ c i Fb(e ' G) ^(i) 



vev(G)\u cec(G) 



k(k - 1) - E yM v * - !) - E f;<^ r * - !) 



where V(G) denotes the set of variable nodes in G, where 
C(G) denotes the set of check nodes in G and where |m| 
denotes degree of node m. Hence, /3(e, t) is obtained by taking 
expectation Et[-] on tree ensemble El of depth t from node 
perspective 



E t [iT(X - 1)P] - V i- Et^i - 1)P] 

^2 



2L'(1) 



where X denotes the number of edges in G, denotes 
the number of variable nodes of degree i, Cj denotes the 
number of check nodes of degree j, and P denotes the erasure 



probability of the root node after t BP iterations. The three 
expectations are obtained using generating functions as 



where E t [K(K-l)P], E t [Vi(Vi - 1)P] and E t [Cj(Cj - 1)P] 
are calculated by ([6]), Q and ©, respectively. 



1)P} = 


d 2 E t [x K P] 


dx 2 


1)P} = 


d 2 E t [x Vi P] 


dx 2 


1)P] = 


d 2 E t [x c iP] 


dx 2 



x=l 



These generating functions E t [x K P], E t [x Vi P] and E^a^'P] 
are obtained using the following lemma. 



Lemma 3. 



= e£(F(t)), 



where 



1, ift = 

/(f) -V(G(t)), otherwise, 
G(t) := g\t) - eC(F(t - 1)), 

fl, ift = 

\V(g(i)), otherwise, 
g{t) := £(/(f - 1)), 



F(t) := 



/(*) 



one/ where 

£(x) := ^ I^x 4 



£(z) :=^A, 



P(x) :=£ 



Using this generating function, those three generating func- 
tions are obtained as 



1 



E t [x K P] 
E t [x v 'P] = E t 
E t {x c tP] = E t 



Ei 



fc i 

k I 



yk—x,zi—x for all k.l 



yi—x,yk — l,zi—l for all k^ij 



Zj—x.yk — l,zi — l for all k,l^j 

From Lemma [3] the derivatives of the generating functions 
can be computed recursively. Since derivation is straightfor- 
ward, we only show the results. 

Theorem 1. (3(e,t) for (X(x) , p(x))-irregular ensembles is 
calculated as 



1 



^ = 217(1) 



t [K(K-l)P] 



]T YEtMVi i)P] - E f E *[^(^ - 



/'(*) == 



0, if t = 

1 + p'(l)<7'(f), otherwise, 

g'(t) :=l + A'(l)/'(*-l). 

r o, ij * = o 

*"(*) == < /'(*)- P(l-Qe(*)) 

[ - Q e (t))G'(t), otherwise, 

G'(t) :=g'{t)-e\{PS-l)) 

-e\'(P e (t-l))F'(t-l), 

{0, ift = 

WW) 
+p"(l)g'(t) 2 + p'(l)g"(t), otherwise, 

g"(t) ■.= 2\>(l)f(t-l) + \"(l)f(t-l) 2 

+ A'(l)/"(t-l), 

'0, i/t = 

/"(f)- 2p'(l-Q e (f))G'(f) 

-p"(l-Q e (t))G'(t) 2 
-p'(l - Q e (t))G"(t), otherwise, 

G"{t) := </'(f) - 2eA'(P e (f - l))F'(f - 1) 

-eA"(P e (f-l))F'(f-l) 2 

-eA'(P e (f-l))F"(f-l), 

E f [^(if-l)P] = e L"(P £ (t))P'(t) 2 + eL'(P e (t))P"(t), (6) 



F"(f) := 



fUt,i) 



0, ift = 

p'(l)g' v (t,i), otherwise, 

g' v (t,t) := A'(l)/^(i - M) + Ai, 
, _ fo, ift = 

'~ - - Qe(t))G' v (t,i), otherwise, 

G' v (t, i) := <£(t, i) - eA'(P e (f - l))Fl(t - 1, i) 
- eA^f - I)*" 1 , 



0, ift = 

/'(l)g' v (t, i) 2 + P '(lK(t, i), otherwise, 

g'^t, i) := X"(l)fUt - 1, *) 2 + A'(l)tf(* - 1, i) 
+ 2A i (<-l)/i(t-l,i). 

{0, jJ * = 

tf(M)-p"(i-Q e (*))Gj,(M) a 
- Q e (t))G't(t, i), otherwise, 

G':(t, i) := <?;'(*, i) - eA"(P e (f - l))iftt - 1, z) 2 
-eA'(P e (t-l))P;(t-l,z) 
- 2eA^ - l)P e (t - 1)*- 2 F^ - 1, z), 



E t [Vi(Vi - 1)P] = eL"(P t {t))F:,{t,i? 

+ eL'{P t (t))F'J(t,i) + 2eL l iP t {tY~ 1 F' v {t,i), (7) 



fc(t,j) ■ = 



0, ift = 

p'(l)5c(^ j) + /°j> otherwise, 
g' c {t,j) :=X'(l)f' c (t-l,j), 

(0, ift = 

3) ■■= \ f'J<t,3) - - Qe(t))G' c (t,j) 

[ — pj(l — Q e (t)) : '~ 1 f otherwise, 
G' c (t,j) := g' c {t,j) - e\'(P e (t - l))F' c (t - 1, j), 



fc(t,j) 



K%3) ■= 



0, ift = 

p"(l)g' c (tjr + p'(l)g^t,j) 

+2pj(j — l)g' c (t, j), otherwise, 
X"(l)f' c (t-lJ) 2 + X'(l)f' c '(t-l,j), 
'O, ift = 

r:{t,j)-p"{i-Q e {t))G' c {t,jf 

-p'{l-QS))G'^3) 
-2 Pj (j-l)(l-Q e (t)¥- 2 
x G' c (t, j), otherwise, 
G»(t,j) := i{t,j) - eX"(P,(t - l))F' c {t - l,jf 
-eX'(P e (t-l))F?(t-l,j), 

E t [C J (C j -l)P\ = eL"(P f Xt))F^t,jf + eL'(P £ (t))F?(t,j). 

(8) 

IV. a(e, t) FOR IRREGULAR EXPURGATED ENSEMBLES 

Consideration of expurgated ensembles is necessary in order 
to optimize performance Q. In this section, we study the 
irregular expurgated ensembles discussed in (6), which are 
defined as follows: If there exists a single-cycle codeword, 
a bit chosen uniformly at random from the cycle is fixed 
to zero. A (X(x), p(x), s)-irregular expurgated ensemble is 
a (X(x), /9(x))-irregular ensemble whose codewords due to 
single cycles of size not greater than s are expurgated. Let 
a(e,t, s) denote the coefficient of ri -1 in the bit error proba- 
bility of a (X(x), p(x), s)-irregular expurgated ensemble. Ac- 
cordingly, let f3(e,t,s) and 7(e,t, s) denote the contributions 
to a(e, t, s) from cycle-free and single-cycle neighborhood 
graphs, respectively. 

Due to limitation of space, we omit details of calculation 
of f3(e, t, s) and 7(5, t, s), as well as the end results, and only 
sketch their derivation. For the calculation, the neighborhood 
graphs of depth up to (t + [^pj) should be considered since 
cycles which are included in neighborhood graphs of depth 
(t+ L^J) w iH affect the bit error probability P b (n,e,£) 
via expurgation. The coefficients /3(e, t, s) and 7(6, t, s) are 
calculated recursively, in ways similar to the calculations of 
P(e,t) and j(e,t), respectively. 



V. Numerical calculations and simulations 

In this section, calculation results of a(e, t) for irreg- 
ular unexpurgated ensembles, and of a(e,t,s) for irregu- 
lar expurgated ensembles, and simulation results for irreg- 
ular unexpurgated ensembles are shown. Figure Q] shows 
calculation results of a(e, t) for an optimized (via density 
evolution [9]) irregular unexpurgated ensemble. It seems to 
converge for all e except the threshold. Although the limit 
linit^+oo a(e, t) is obtained for regular ensembles iflOl . it has 
not been obtained for irregular ensembles, nor a proof of the 
convergence. Figure [2] shows |a(e,t)| and simulation results 
of |n(Pb(n, e, i) — Pb(oo, e, i))| which should converge to 
|a(e,t)| as n — » 00. The simulation results are almost the 
same as the limit a(e,t). It is practically plausible but the- 
oretically very strange, since a(e,t) consists of contributions 
of cycle-free and single-cycle neighborhood graphs, whereas 
the probabilities of cycle-free and single-cycle neighborhood 
graphs are effectively zero when the blocklength is 5760 and 
the number of iterations is 20. Figure [3] shows calculation 
results of a(e, t, s) for an irregular expurgated ensemble. 
The coefficient a(e,t,s) of decreases as expurgation 
size s increases. Unfortunately, we can not simulate irregular 
expurgated ensembles due to its high computational costs. 



VI. Conclusion and future works 

The coefficient a(e,t) of n" 1 in the bit error probability 
for irregular expurgated ensembles are obtained. A reason of 
the strangely fast convergence to a(e, t) is an open problem. 
Finite-length and finite-iteration optimization is an important 
future work. Furthermore, generalization to binary memoryless 
symmetric channels remains to be done. 




Fig. 1. Calculation results for an irregular unexpurgated ensemble. A(x) = 
0.500x + 0.153x 2 + 0.112a; 3 + 0.055a; 4 + 0.180a; 8 , p(x) = 0.492^2 + 
0.508z 3 . Thin curves show results for t = 1, 2, . . . , 8. Thick curve shows 
result for t = 50. The threshold is about 0.8. 
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Simulation results for an irregular unexpurgated ensemble. A(a:) 
h0.153x 2 +0.112x 3 + 
Blocklengths are 360 



0.055a: 4 + 0.180a; 8 , p(x) = 0A92x z + 
720 and 5760. The number of iterations is 
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Fig. 3. Calculation results for irregular expurgated ensembles. A(x) = 
0.500a: + 0.153a: 2 + 0.112x 3 + 0.055a: 4 + 0.180a; 8 , p(x) = 0.492a: 2 + 
0.508a: 3 . The number of iterations is 10. The top curve shows results for 
an irregular unexpurgated ensemble. The other curves are results for irregular 
expurgated ensembles where the size of expurgations varies from 1 to 21. 



